The 10 longest words with frequency>1, ordered by length
| Length | Frequency | Word |
|---|---|---|
| 30 | 2 | الاسكندرية(العالم)-28/11/2011- |
| 30 | 2 | الانبار(العالم)-26/10/2017- |
| 30 | 2 | كوالالمبور(العالم)-12/09/2017- |
| 29 | 2 | اللبنانية(العالم)-22/08/2017- |
| 29 | 2 | الرباط(العالم)-26/10/2017- |
| 29 | 3 | بانوراما-(العالم)-02-10-2016- |
| 29 | 2 | بروكسل(العالم)-22/10/2017- |
| 28 | 2 | بغداد(العالم)-22/10/2017- |
| 28 | 2 | صنعاء(العالم)-26/10/2017- |
| 28 | 4 | الزور(العالم)-22/10/2017- |
The longest words of the corpus with minimum frequency 2 are shown. The words are seen at least twice, hence, there is some chance for not seeing misprinted words.
Surprisingly, there is no longest word which is much longer than the second one. This, again, argues for correct preprocessing.
In the case of correct preprocessing, the longest words are true words. In many cases, they belong to some topics which can generate these long words.
In the case of poor preprocessing, some non-word strings will appear.
The length of the longest words clearly depends on language and corpus size.
select char_length(word) as le, freq, word from words where freq>1 order by le desc limit 10;
How does the length of the longest words increase with corpus size?
3.2.3.1 Longest Words in top-1000 by length